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Abstract — A  loop- free  path-finding  algorithm  (LPA)  is  pre¬ 
sented;  this  is  the  first  routing  algorithm  that  eliminates  the 
formation  of  temporary  routing  loops  without  the  need  for 
internodal  synchronization  spanning  multiple  hops  or  the 
specification  of  complete  or  variable-size  path  information. 
Like  other  previous  algorithms,  LPA  operates  by  specify¬ 
ing  the  second-to-last  hop  and  distance  to  each  destination; 
this  feature  is  used  to  ensure  termination.  In  addition,  LPA 
uses  an  inter-neighbor  synchronization  mechanism  to  elim¬ 
inate  temporary  routing  loops.  A  detailed  proof  of  LPA’s 
correctness  and  loop-freedom  property  is  presented  and  its 
complexity  is  evaluated.  LPA’s  average  performance  is  com¬ 
pared  by  simulation  with  the  performance  of  algorithms  rep¬ 
resentative  of  the  state  of  the  art  in  distributed  routing, 
namely  an  ideal  link-state  (ILS)  algorithm,  a  loop-free  al¬ 
gorithm  that  is  based  on  internodal  coordination  spanning 
multiple  hops  (DUAL)  and  a  path-finding  algorithm  without 
the  inter-neighbor  synchronization  mechanism.  The  simu¬ 
lation  results  show  that  LPA  is  a  more  scalable  alternative 
than  DUAL  and  ILS  in  terms  of  the  average  number  of 
steps,  messages,  and  operations  needed  for  each  algorithm 
to  converge  after  a  topology  change. 


1  Introduction 

RIP  [9]  is  widely  used  in  internets  today.  However,  it  is 
based  on  the  distributed  Bellman-Ford  algorithm  (DBF) 
for  shortest-path  computation  [1],  which  suffers  from  bounc¬ 
ing  effect  and  counting-to-infinity  problems.  These  prob¬ 
lems  are  overcome  in  one  of  three  ways  in  existing  Inter¬ 
net  routing  protocols.  OSPF  [16]  relies  on  broadcasting 
complete  topology  information  among  routers,  and  orga¬ 
nizes  an  Internet  hierarchically  to  cope  with  the  overhead 
incurred  with  topology  broadcast.  BGP  [12]  exchanges 
distance  vectors  that  specify  complete  path  to  destina¬ 
tions.  EIGRP  [2]  uses  a  loop-free  routing  algorithm  called 
DUAL  [5],  which  is  based  on  internodal  coordination  that 
can  span  multiple  hops;  DUAL  also  eliminates  temporary 
routing  loops. 

Recently,  distributed  shortest-path  algorithms  [3,  5,  8, 
10,  17,  19]  that  utilize  information  regarding  the  length 
and  second-to-last  hop  (predecessor)  of  the  shortest  path 
to  each  destination  have  been  proposed  to  eliminate  the 
performance  problems  of  DBF.  We  call  these  type  of  algo¬ 
rithms  path-finding  algorithms.  Although  these  algorithms 
provide  a  marked  improvement  over  DBF,  they  do  not 
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eliminate  the  possibility  of  temporary  loops.  All  the  loop- 
free  algorithms  reported  to  date  rely  on  mechanisms  that 
require  routers  to  either  synchronize  along  multiple  hops 
[5,  11,  15],  or  exchange  path  information  that  can  include 
all  the  routers  in  the  path  from  source  to  destination  [7]. 
This  paper  presents  the  loop-free  path-finding  algorithm 
(LPA)  which  is  the  first  routing  algorithm  that  is  loop- 
free  at  every  instant  and  does  not  use  either  of  these  two 
techniques. 

Like  previous  path-finding  algorithms,  LPA  eliminates 
the  counting-to-infinity  problem  of  DBF  using  predecessor 
information.  Because  each  router  reports  to  its  neighbors 
the  predecessor  to  each  destination,  any  router  can  traverse 
the  path  specified  by  the  predecessors  from  any  destination 
back  to  a  neighbor  router  to  determine  if  using  that  neigh¬ 
bor  as  its  successor  would  create  a  path  that  contains  a  loop 
(i.e.,  involves  the  router  itself).  Furthermore,  a  router  de¬ 
tects  a  temporary  loop  within  a  finite  time  that  depends 
on  the  speed  with  which  correct  predecessor  information 
reaches  the  router,  and  not  on  the  distance  values  of  the 
paths  offered  by  its  neighbors;  therefore,  temporary  loops 
are  detected  much  faster  than  in  DBF  and  its  variations. 

Of  course,  updates  take  time  to  be  propagated  and  routers 
have  to  update  their  routing  tables  using  information  that 
can  be  out  of  date,  which  can  lead  to  temporary  loops.  In 
LPA,  when  a  router  detects  that  it  can  create  a  routing  ta¬ 
ble  loop  if  it  changes  its  successor  to  a  destination,  it  blocks 
such  a  potential  loop.  The  router  accomplishes  this  by  re¬ 
porting  an  infinite  distance  for  the  destination  to  all  its 
neighbors  and  by  waiting  for  those  neighbors  to  acknowl¬ 
edge  its  message  with  their  own  distances  and  predecessor 
information,  before  the  router  changes  its  successor.  Be¬ 
cause  of  the  overhead  involved,  a  router  should  not  send  a 
query  every  time  it  has  to  change  its  successor  to  a  desti¬ 
nation;  a  router  decides  when  to  block  a  potential  loop  by 
comparing  the  distances  reported  by  its  neighbors  against 
a  feasible  distance,  which  is  defined  to  be  the  smallest  value 
achieved  by  the  router’s  own  distance  since  the  last  query 
sent  by  the  router.  The  router  is  forced  to  block  a  po¬ 
tential  loop  with  a  query  only  when  no  neighbor  reports 
a  distance  smaller  than  the  router’s  own  feasible  distance. 
This  feature  accounts  for  the  low  overhead  incurred  in  LPA 
to  accomplish  loop-free  paths  at  every  instant. 

The  rest  of  the  paper  is  organized  as  follows.  Section  2 
presents  the  network  model  assumed  in  LPA.  Section  3  pro¬ 
vides  a  description  of  LPA.  Section  4  and  Section  5  provide 
a  detailed  proof  of  LPA’s  loop-freedom  and  convergence  to 
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correct  routing  tables,  respectively.  Section  6  addresses 
the  complexity  of  LPA,  analyzes  its  average  performance 
by  simulation,  and  compares  it  with  other  algorithms.  Fi¬ 
nally,  Section  7  presents  our  conclusions. 

2  Network  Model 

A  computer  network  is  modeled  as  an  undirected  finite 
graph  represented  as  G(N,  E),  where  N  is  the  set  of  nodes 
and  E  is  the  set  of  edges  or  links  connecting  the  nodes.  For 
simplicity,  each  node  represents  a  router  that  is  a  comput¬ 
ing  unit  involving  a  processor,  local  memory  and  input  and 
output  queues  with  unlimited  capacity.  LPA  can  be  applied 
to  networks  in  which  nodes  represent  address  ranges  [22]. 
A  functional  bidirectional  link  connecting  nodes  i  and  j  is 
represented  by  (i,j)  is  assigned  a  positive  weight  in 
each  direction.  The  link  is  assumed  to  exist  in  both  direc¬ 
tions  at  the  same  time.  All  the  messages  received  (trans¬ 
mitted)  by  a  node  are  put  in  the  input  (output)  queue  and 
are  processed  on  a  first-come-first-serve  basis.  Each  node 
has  a  unique  identifier.  Any  link  cost  can  vary  in  time  but 
is  always  positive.  The  distance  between  two  nodes  in  the 
network  is  measured  as  the  sum  of  the  link  costs  of  the 
shortest  path  between  the  nodes.  An  underlying  protocol 
assures  that: 

•  Within  a  finite  time,  a  node  detects  the  existence  of  a 
new  neighbor,  loss  of  connectivity  with  a  neighbor,  or 
the  change  in  the  cost  of  an  adjacent  link. 

•  All  packets  transmitted  over  an  operational  link  are 
received  correctly  and  in  the  proper  sequence  within  a 
finite  time.  This  assumption  is  made  for  convenience. 
Reliable  message  transmission  can  be  easily  incorpo¬ 
rated  into  the  routing  protocol  (e.g.,  [16,  21]). 

•  All  update  messages,  changes  in  the  link-cost,  link  fail¬ 
ures  and  link  recoveries  are  processed  one  at  a  time  in 
the  order  in  which  they  occur. 

When  a  link  fails,  the  corresponding  distance  entry  in  the 
node’s  distance  and  routing  tables  are  marked  as  infinity. 
A  node  failure  is  modeled  as  all  the  links  incident  on  that 
node  failing  at  the  same  time. 

A  path  from  node  i  to  node  j  is  a  sequence  of  nodes  in 
which  (f,ni),  (nr,j)  fhe  links  in  the  path. 

A  simple  path  from  i  to  j  is  a  sequence  of  nodes  in  which 
no  node  is  visited  more  than  once.  The  paths  between  any 
pair  of  nodes  and  their  corresponding  distances  change  over 
time  in  a  dynamic  network.  At  any  point  in  time,  node  i 
is  connected  to  node  j  if  a  path  exists  from  i  to  j  at  that 
time.  The  network  is  said  to  be  connected  if  every  pair  of 
operational  nodes  are  connected  at  a  given  time. 

3  LPA  Description 

3.1  Information  Stored  and  Exchanged 

In  LPA’s  description,  the  time  at  which  the  value  of  a  vari¬ 
able  X  of  the  algorithm  applies  is  specified  only  when  it  is 


necessary;  the  value  of  X  at  time  t  is  denoted  by  X(t). 

Each  router  maintains  a  distance  table,  a  routing  table 
and  a  link-cost  table.  The  distance  table  at  each  router  i 
is  a  matrix  containing,  for  each  destination  j  and  for  each 
neighbor  k  of  router  i,  the  distance  and  the  predecessor 
reported  by  router  k,  denoted  by  respectively. 

The  set  of  neighbors  of  router  i  is  denoted  by  A, . 

The  routing  table  at  router  i  is  a  column  vector  contain¬ 
ing,  for  each  destination  j,  the  minimum  distance  (T*)),  the 
predecessor  (p)),  the  successor  (s)),  and  a  marker  (tag^) 
used  to  update  the  routing  table.  Eor  destination  j,  tag^ 
specifies  whether  the  entry  corresponds  to  a  simple  path 
(tagj  =  correct),  a  loop  (tag)  =  error)  or  a  destination 
that  has  not  been  marked  (tag)  =  null). 

The  link-cost  table  lists  the  cost  of  each  link  adjacent  to 
the  router.  The  cost  of  the  link  from  i  to  k  is  denoted  by 
dij.  and  is  considered  to  be  infinity  when  the  link  fails. 

An  update  message  from  router  i  consists  of  a  vector  of 
entries  reporting  incremental  updates  to  its  routing  table; 
each  entry  specifies  an  update  flag  (denoted  by  u)),  a  desti¬ 
nation  j,  the  reported  distance  to  that  destination  (denoted 
by  RD)),  and  the  reported  predecessor  in  the  path  to  the 
destination  (denoted  by  rp)).  The  update  flag  indicates 
whether  the  entry  is  an  update  (u)  =  0),  a  query  (u)  =  1) 
or  a  reply  to  a  query  (u)  =  2).  The  distance  in  a  query  is 
always  set  to  oo. 

Because  every  router  reports  to  its  neighbors  the  prede¬ 
cessor  in  the  shortest  path  to  each  destination,  the  com¬ 
plete  path  that  a  router  assumes  to  any  destination  (called 
its  implicit  path  to  the  destination)  at  a  given  time  t  is 
known  by  the  router’s  neighbors  at  the  subsequent  time 
t  >  t  .  This  is  done  by  means  of  a  path  traversal  routine 
on  the  predecessor  entries  reported  by  the  router.  In  the 
specification  of  LPA,  the  successor  to  destination  j  for  any 
router  is  simply  referred  to  as  the  successor  of  the  router, 
and  the  same  reference  applies  to  other  information  main¬ 
tained  by  a  router.  Similarly,  updates,  queries  and  replies 
refer  to  destination  j,  unless  stated  otherwise.  Eigures  1 
and  2  specify  LPA  in  pseudo-code.  The  rest  of  this  section 
provides  an  informal  description  of  LPA. 

The  procedures  used  for  initialization  are  Initl  and  Init2; 
Procedure  Message  is  executed  when  a  router  processes  an 
update  message;  procedures  linkUp,  linkDown  and  linkChange 
are  executed  when  a  router  detects  a  new  link,  the  failure  of 
a  link,  or  the  change  in  the  cost  of  a  link.  We  refer  to  these 
procedures  as  event-handling  procedures.  Eor  each  entry 
in  an  update  message.  Procedure  Message  calls  procedure 
Update,  Query,  or  Reply  to  handle  an  update,  a  query,  or 
a  reply,  respectively.  An  important  characteristic  of  all 
event-handling  procedures  is  that  they  mark  tag)  =  null 
for  each  destination  j  affected  by  the  input  event. 

Router  i  initializes  itself  in  passive  state  with  an  infinite 
distance  for  all  its  known  neighbors  and  with  a  zero  dis¬ 
tance  to  itself.  After  initialization,  router  i  sends  updates 
containing  the  distance  to  itself  to  all  its  neighbors. 


3.2  Distance  Table  Updating 

When  router  i  receives  an  input  event  regarding  neighbor  k 
(an  update  message  from  neighbor  or  a  change  in  the  cost 
or  status  of  link  it  updates  its  link-cost  table  with 

the  new  value  of  link  dij,  if  needed,  and  then  executes  pro¬ 
cedure  DT .  The  intent  of  this  procedure  is  for  the  router  to 
erase  the  outdated  path  information  in  the  distance  table 
by  making  path  information  from  all  neighbors  consistent 
with  the  latest  update.  To  accomplish  this,  DT  updates 
the  distance  and  predecessor  of  neighbor  k  as  =  Dj 
and  p’jj.  =  for  each  destination  j  affected  by  the  input 
event.  In  addition,  DT  determines  whether  the  path  to  any 
destination  j  through  any  of  the  other  neighbor  of  router 
i  includes  neighbor  k.  This  is  done  by  traversing  the  path 
specified  by  the  predecessor  entries  reported  by  a  neighbor 
from  destination  j  towards  node  i.  If  the  path  implied  by 
the  predecessor  reported  by  router  b  (b  ^  k  and  b  ^  Ni)  to 
destination  j  includes  router  k,  then  node  i  assumes  that 
b  has  outdated  path  information  and  substitutes  the  sub¬ 
path  from  k  to  j  reported  by  b  as  part  of  its  path  to  j  with 
the  path  to  i  reported  by  k  itself.  This  is  easily  done  by 
updating  and  p*  j  =  p|. 

The  example  in  Figure  3  illustrates  how  procedure  DT 
helps  to  expedite  LPA’s  convergence.  In  the  example,  router 
X  has  reported  to  i  its  predecessors  to  y  and  j,  and  i  infers 
that  a;’s  path  to  j  is  xyj.  Router  c  has  reported  to  i  its 
predecessors  to  d,  a,  b  and  j,  and  i  infers  that  c’s  path  to 
j  is  cdabj.  Router  a  has  reported  to  i  its  predecessors  to 
b  and  j,  and  i  infers  that  a’s  path  to  j  is  abj.  With  these 
conditions,  assume  that  a  sends  i  an  update  stating  that 
=  oo  and  p“  =  null.  Router  i  uses  procedure  DT  to 
ensure  that  the  path  information  from  the  other  neighbors 
reflects  the  most  recent  update  obtained  from  any  other 
neighbors  for  any  destination.  Since  c’s  path  to  j  includes 
a,  i  substitutes  the  out-of-date  subpath  abj  in  c’s  path  in¬ 
formation  with  the  information  supplied  by  a,  which  makes 
the  path  from  c  to  j  non-existent.  The  path  from  x  to  j 
does  not  include  a  and  i  does  not  change  a;’s  information. 
Note  that  i  does  not  have  to  wait  for  an  update  from  c  to 
infer  that  it  should  not  use  c  as  successor  to  j. 

3.3  Blocking  Temporary  Loops 

The  example  shown  in  Figure  4  illustrates  the  possibility 
of  looping,  even  when  path  information  is  used.  In  the 
example,  it  is  assumed  that  a  has  reported  the  implicit 
path  aj  to  i  and  that  b  has  reported  the  implicit  path 
bcdj  to  i.  Furthermore,  this  path  information  is  outdated, 
because  c  has  changed  its  successor  from  d  to  e  and  the 
new  path  information  has  not  reached  i.  If  link  («,  a)  fails, 
simply  using  path  information  would  permit  i  to  use  b  as 
successor  to  j.  However,  this  would  create  a  temporary 
routing  loop. 

To  eliminate  temporary  loops,  a  router  i  forces  its  neigh¬ 
bors  not  to  use  it  as  a  successor  (next  hop)  when  it  de¬ 
tects  the  possibility  of  creating  a  temporary  loop  before  i 
changes  its  own  successor.  This  is  done  using  an  interneigh¬ 


bor  synchronization  mechanism  based  on  the  notion  of  fea¬ 
sible  distance. 

The  feasible  distance  of  router  i  for  destination  j  (de¬ 
noted  by  F Dj)  is  the  smallest  value  achieved  by  its  own 
distance  to  j  since  the  last  time  i  initialized  itself  or  sent 
a  query  reporting  an  infinite  distance  to  j.  LPA  allows  a 
router  to  use  a  neighbor  k  as  its  successor  to  destination  j 
only  if  it  satisfies  the  following  condition. 

Feasibility  Condition  (FC):  If  at  time  t  router  i  needs 
to  update  its  current  successor,  it  can  choose  as  its  new 
successor  st(t)  any  router  n  G  Ni(t)  such  that  + 

—  Fmin  (t)  =  Min{Dj^{t)  +  di^{t)\x  e  and 

Djnit)  <  FDj(t).  If  no  such  neighbor  exists  and  Dj(t)  < 
oo,  router  i  must  keep  its  current  successor.  If  Dminit)  = 
oo  then  st(t)  =  null. 

FC  is  used  to  establish  an  ordering  of  routers  along  a 
given  loop-free  path  to  j,  i.e.,  all  the  routers  in  a  loop-free 
path  to  j  have  feasible  distances  to  j  that  decrease  as  j  is 
approached.  If  router  i  does  not  find  neighbor  that  satisfies 
FC,  it  is  forced  to  send  a  query  to  its  neighbors  reporting 
an  infinite  distance  to  j  and  waits  for  the  replies  before  it 
can  change  its  own  route.  Because  every  router  uses  FC 
to  decide  whether  to  adapt  a  successor  or  to  block  paths 
through  itself  (as  described  in  Section  3.4),  no  temporary 
loops  can  exist. 

3.4  Routing  Table  Updating 

After  procedure  DT  is  executed,  the  way  in  which  router  i 
updates  its  routing  table  for  a  given  destination  depends  on 
whether  router  i  is  passive  or  active  for  that  destination. 
A  router  is  passive  if  it  has  a  feasible  successor,  or  has 
determined  that  no  such  successor  exists  and  is  active  if  it 
is  searching  for  a  feasible  successor.  A  feasible  successor  for 
router  i  with  respect  to  destination  j  is  a  neighbor  router 
that  satisfies  FC. 

When  router  i  is  passive,  it  reports  the  current  value  of 
Dj  in  all  its  updates  and  replies.  While  router  i  is  active, 
it  sends  an  infinite  distance  in  its  replies  and  queries.  An 
active  router  cannot  send  an  update  regarding  the  desti¬ 
nation  for  which  it  is  active,  this  is  because  any  update 
sent  during  active  state  would  necessarily  have  to  report 
an  infinite  distance  to  ensure  the  correct  operation  of  the 
inter- neighbor  synchronization  mechanism  used  in  LPA. 

If  router  i  is  passive  when  it  processes  an  update  for 
destination  j,  it  determines  whether  or  not  it  has  a  feasible 
successor,  i.e.,  a  neighbor  router  that  satisfies  FC. 

If  router  i  finds  a  feasible  successor,  it  sets  TDj  equal 
to  the  smaller  of  the  updated  value  of  Dj  and  the  present 
value  of  FDj.  In  addition,  it  updates  its  distance,  prede¬ 
cessor,  and  successor  making  sure  that  only  simple  paths 
are  used,  as  described  in  Section  3.5. 

Router  i  then  prepares  an  update  message  to  its  neigh¬ 
bors  if  its  routing  table  entry  changes.  Alternatively,  if 
router  i  finds  no  feasible  successor,  then  it  sets  F D'j  =  oo 
and  updates  its  distance  and  predecessor  to  reflect  the  in¬ 
formation  reported  by  its  current  successor.  If  Dj(t)  =  oo, 
then  Sj  (t)  =  null.  Router  i  also  sets  the  reply  status  flag 


=  1)  for  all  k  G  Ni  and  sends  a  query  to  all  its  neigh¬ 
bors.  Router  i  is  then  said  to  be  active,  and  cannot  change 
its  path  information  until  it  receives  all  the  replies  to  its 
query. 

Queries  and  replies  are  processed  in  a  manner  similar  to 
the  processing  of  an  update  described  above.  If  the  input 
event  that  causes  router  i  to  become  active  is  a  query  from 
its  neighbor  k,  router  i  sends  a  reply  to  router  k  reporting 
an  infinite  distance.  This  is  the  case,  because  router  k’s 
query,  by  definition,  reports  the  latest  information  from 
router  k,  and  router  i  will  send  an  update  to  router  k  when 
it  becomes  passive  if  its  distance  is  smaller  than  infinity.  A 
link-cost  change  is  treated  as  a  number  of  updates. 

Once  router  i  is  active  for  destination  j,  it  may  not  have 
to  do  anything  more  regarding  that  destination  after  exe¬ 
cuting  procedures  RT  and  DT  as  a  result  of  an  input  event. 
However,  when  router  i  is  active  and  receives  a  reply  from 
router  k,  it  updates  its  distance  table  and  resets  the  reply 
flag  (rj,.  =  0). 

Router  i  becomes  passive  at  time  t  when  it  receives 
replies  from  all  its  neighbors  indicating  that  they  have  pro¬ 
cessed  its  query.  As  a  result,  router  i  is  free  to  choose  any 
neighbor  that  provides  the  shortest  distance,  if  there  is  any. 
If  such  a  neighbor  is  found,  router  i  updates  the  routing  ta¬ 
ble  with  the  minimum  distance  as  described  for  the  passive 
state  and  sets  F D’j  =  . 

A  router  does  not  wait  indefinitely  for  replies  from  its 
neighbors  because  a  router  replies  to  all  its  queries  regard¬ 
less  of  its  state.  Thus,  there  is  no  possibility  of  deadlocks 
due  to  the  inter-neighbor  coordination  mechanism. 

If  router  i  is  passive  and  has  already  set  its  distance  to 
infinity  (£)j  =  oo),  and  receives  an  input  event  that  implies 
an  infinite  distance  to  j,  then  router  i  simply  updates 
and  dik,  and  sends  a  reply  to  router  k  with  an  infinite 
distance  if  the  input  event  is  a  query  from  router  k.  This 
ensures  that  update  messages  will  stop  when  a  destination 
becomes  unreachable. 

Figure  5  illustrates  the  interneighbor  coordination  mech¬ 
anism  of  LPA.  The  number  adjacent  to  each  link  represents 
the  weight  of  that  link;  U  indicates  updates,  Q  represents 
queries  and  R  replies.  The  arrowhead  from  node  x  to  node 
y  indicates  that  node  y  is  the  successor  of  node  x  towards 
destination  j;  i.e.,  sj  =  y.  The  label  in  the  parenthesis 
assigned  to  node  x  indicates  current  distance  (T*J)  and  the 
feasible  distance  from  x  to  destination  j  (FDj).  Active 
nodes  are  indicated  in  black. 

In  the  example  (Figure  5),  we  assume  that  messages 
propagate  across  all  links  at  the  same  speed,  which  is  con¬ 
sidered  a  step.  Node  processes  all  messages  received  in  the 
previous  step  in  zero  time. 

When  link  (a,j)  fails,  node  a  updates  its  distance  table 
by  setting  the  distances  from  d  and  b  to  j  equal  to  oo, 
because  the  paths  to  j  reported  by  both  b  and  d  include  a. 
After  that,  node  a  is  unable  to  find  a  feasible  successor  to 
j,  because  =  oo  >  1  =  F .  Accordingly,  it 

sends  a  query  to  all  its  neighbors  (Figure  5(b)). 

When  node  d  receives  a’s  query,  it  updates  its  distance 
table  as  follows:  it  sets  =  oo  because  a  reports  = 


CO,  and  it  sets  =  CO,  because  the  paths  to  j 

reported  by  b  and  d  include  node  a.  Because  d  uses  a 
to  reach  j,  d  must  also  update  its  routing  table.  After 
updating  its  distance  table,  the  neighbor  that  offers  the 
shortest  distance  to  j  is  j  itself.  Furthermore,  DF  =  Q  < 
2  =  FDj,  and  d  sends  an  update  to  all  its  neighbor  with 
Dj  =  1  +  9  =  10  and  a  reply  to  node  a  (Figure  5(c)). 

When  node  b  receives  a’s  query  (before  receiving  a  new 
update  from  d),  it  must  set  Dj^  =  =  oo,  be¬ 

cause  all  its  neighbors  have  reported  a  path  to  j  that  in¬ 
clude  node  a.  Because  6’s  own  path  to  j  includes  node  a, 
it  must  update  its  routing  table.  Node  b  sends  a  query 
to  its  neighbors  because  every  distance  to  j  through  any 
neighbor  is  infinity  (Figure  5(c)). 

When  a  receives  the  replies  from  d  and  b,  it  makes  node  d 
its  new  successor  and  also  sends  a  reply  to  b  (Figure  5(d)). 
When  c  receives  the  update  from  d  and  the  query  from  b, 
it  makes  e  its  successor,  because  =  1  <  4  =  F and 

'  J  ^  J 

e  offers  the  shortest  path  to  j  among  all  of  c’s  neighbors. 
Accordingly,  c  sends  an  update  with  its  new  distance  of  10 
and  a  reply  to  6’s  query. 

Finally,  when  b  receives  all  the  replies  to  its  queries,  it 
sets  d  as  its  successor  and  sends  updates  accordingly  (Fig¬ 
ure  5(e)). 

3.5  Ensuring  Simple  Paths 

Procedure  TRT  ensures  that  any  finite  distance  in  the  rout¬ 
ing  table  corresponds  to  a  simple  path  by  allowing  router  i 
to  select  successors  to  destinations  as  only  those  neighbors 
that  satisfy  the  following  property: 

Property  1:  Router  i  sets  s)  =  ^;  at  time  t  only  if 

Dl,^(t)  +  dii.(t)  <  D^,^p(t)  +  dip(t)  for  every  neighbor  p  other 
than  k  and  for  every  node  x  in  the  path  from  i  to  j  defined 
by  the  predecessors  reported  by  neighbor  k. 

Let  denote  the  path  from  k  to  j  defined  by  the 

predecessors  reported  by  neighbor  k  to  router  i  and  stored 
in  router  f’s  distance  table  at  time  t.  Procedure  TRT  en¬ 
forces  Property  1  by  traversing  all  or  part  of  from 

j  back  to  k  using  the  predecessor  information.  This  path 
traversal  ends  when  either  a  predecessor  x  is  reached  for 
which  tagl,  =  correct  or  error,  or  neighbor  k  is  reached. 
If  tagl,  —  sfror,  then  tag^  is  set  to  error  also;  otherwise, 
neighbor  or  a  correct  tag  must  be  reached,  in  which  case 
tagj  is  set  to  correct.  Lemma  2  shows  that  this  traversal 
correctly  enforces  Property  1,  without  having  to  traverse 
an  entire  implicit  path;  as  the  simulation  results  presented 
in  Section  6  show,  this  makes  LPA  considerably  more  effi¬ 
cient  than  other  prior  path  finding  algorithms  [3,  10,  19]. 

3.6  Handling  Topology  Changes 

When  router  i  establishes  a  link  with  a  neighbor  k,  it  up¬ 
dates  its  link-cost  table  and  assumes  that  router  k  has  re¬ 
ported  infinite  distances  to  all  destinations  and  has  replied 
to  any  query  for  which  router  i  is  active;  furthermore,  if 
router  is  a  previously  unknown  destination,  router  i  ini¬ 
tializes  the  path  information  of  router  k  and  sends  an  up- 


date  to  the  new  neighbor  k  for  each  destination  for  which  it 
has  a  finite  distance.  When  router  i  is  passive  and  detects 
that  link  (i,  k)  has  failed,  it  sets  dn-  =  oo,  D^j.  =  oo  andpj,;, 
=  null;  after  that,  router  i  carries  out  the  same  steps  used 
for  the  reception  of  a  link-cost  change  message  in  passive 
state.  When  router  i  is  active  and  loses  connectivity  with 
a  neighbor  k,  it  resets  the  reply  flag  and  resets  the  path 
information  i.e.,  assumes  that  the  neighbor  k  sent  a  reply 
reporting  an  infinite  distance. 

It  follows  from  the  above  description  that  the  order  in 
which  router  i  processes  updates,  queries  and  replies  does 
not  change  with  the  establishment  of  new  links  or  link  fail¬ 
ures.  The  addition  or  failure  of  a  router  is  handled  by  its 
neighbors  as  if  all  the  links  connecting  to  that  router  were 
coming  up  or  going  down  at  the  same  time. 

4  Loop  Freedom  in  LPA 

The  successor  graph  for  destination  j  G  G,  denoted  by 
Sj(G),  is  a  directed  graph  in  which  nodes  are  the  same  as 
the  nodes  of  G  and  where  directed  links  are  determined 
by  the  successor  entries  in  the  nodal  routing  tables.  Loop 
freedom  of  routing  tables  is  guaranteed  at  all  times  in  G  if 
Sj(G)  is  always  a  directed  acyclic  graph.  If  G  is  connected 
in  steady  state,  when  all  routing  tables  are  correct,  Sj(G) 
must  be  a  directed  tree  whose  links  point  to  j. 

It  is  clear  that  Sj(G)  would  be  loop  free  at  every  instant 
if  a  router  sent  a  query  reporting  an  infinite  distance  to 
its  neighbors  every  time  it  needed  to  change  successors, 
because  no  router  would  change  Sj(G)  before  blocking  any 
potential  loop  by  sending  an  infinite  distance  “upstream” 
the  loop.  However,  it  is  not  obvious  that  loop  freedom  is 
maintained  at  every  instant  when  routers  use  FG  to  decide 
if  they  have  to  send  a  query  before  changing  Sj(G).  The 
following  theorem  shows  that  this  is  the  case,  i.e.,  that 
LPA  is  free  of  loops  at  every  instant.  The  proof  is  by 
contradiction. 

Proposition  1:  If  a  loop  is  formed  in  the  successor  graph 
Sj(G)  for  the  first  time  at  time  t,  then  some  router  i  in 
that  loop  must  choose  an  upstream  router  as  its  successor 
at  time  t. 

By  assumption,  Sj(G)  is  a  directed  acyclic  graph  before 
the  loop  is  formed  at  time  t.  If  a  loop  has  to  be  formed  at 
time  t,  there  must  be  at  least  one  router  k  G  Sj(G)  that 
changes  its  successor  because  the  successor  information  can 
be  changed  only  when  an  update  occurs  or  when  the  router 
detects  a  change  in  a  link  cost  or  status.  This  implies  that 
an  upstream  router  will  be  chosen  by  some  router  x  in  the 
loop.  □ 

Theorem  1  In  a  network  G,  the  successor  graph  Sj(G)  is 
loop-free  at  every  instant  t. 

Proof:  The  proof  is  by  contradiction  to  FC. 

Let  G  be  a  stable  topology  and  let  the  successor  graph 
Sj(G)  be  loop-free  at  every  instant  before  t.  Let  Gj(t)  be 
the  loop  formed  in  the  successor  graph  at  time  t.  It  is  ev¬ 
ident  that  no  loops  can  be  created  unless  routers  change 
successors  and  modify  the  successor  graph  Sj(G),  and  it 


follows  from  Proposition  1  that  at  least  one  router  must 
change  its  successor  at  time  t  and  choose  an  upstream 
neighbor  for  a  loop  to  be  formed. 

At  time  t  =  0,  when  the  network  is  first  initialized,  each 
router  knows  only  how  to  reach  itself.  This  is  equivalent  to 
saying  that  at  time  0,  Sj(G)  is  a  disconnected  graph  of  one 
or  more  components,  each  with  a  single  router.  Therefore 
Sj(G)  is  loop-free  at  time  t  =  0. 

Let  t  >  0,  and  assume  that  a  loop  Gj(t)  is  formed  when 
router  i  makes  router  a  (=s[l,  new])  its  new  successor  (Fig¬ 
ure  6).  This  implies  the  path  from  a  to  j  at  time  t,  denoted 
by  Paj(i),  includes  Pai(t). 

Let  path  Pai(t)  consist  of  a  chain  of  routers  {a,  s[2,  new], 
...,  i},  as  shown  in  Figure  6.  Router  s[^;,  new]  is  the  ^;th  hop 
in  the  path  Pai  at  time  t  and  s[k  +  1,  new]  is  its  successor 
at  time  t.  Router  s[k,new]  sets  q.  l^new] 

at  time  <  t  and  makes  no  more  updates  to  its 

successor  in  the  time  interval  therefore, 

s\k  ,n ew'\ /■ ,  \  sr/:,neit)l/ ,\ 

(^s[A  +  l,neit)])  —  (^) 

,n eiiil  /  ,  \  /  ,\ 

+  (i) 

Similarly,  router  s[k  +  1,  old]  is  router  s[^;,  neu>]’s  suc¬ 
cessor  just  before  node  s[^;,  new]  becomes  the  ^;th  hop  of 
path  Pai(t)  by  making  router  s[k  +  1,  new]  its  successor  at 
time  ts[k+  l,new]  ^ 

Because  all  the  routers  in  Gj(t)  must  have  a  successor  at 
time  t,  all  of  them  must  be  passive  at  that  time.  If  all  the 
routers  in  Gj(t)  have  always  been  passive  before  time  t,  it 
follows  from  Theorem  1  in  [5]  that  router  i  cannot  create 
Gj(t)]  the  proof  of  that  theorem  is  based  on  the  fact  that 
F Dj  can  only  decrease  as  long  as  router  i  is  passive.  The 
rest  of  the  proof  needs  to  show  that  Gj  (t)  cannot  be  formed 
if  at  least  one  router  in  Pai(t)  was  temporarily  active  before 
time  t. 

Consider  the  case  in  which  node  s[^;,  new]  G  Pajit)  is 
already  passive  before  it  updates  its  distance  and  successor 
to  join  Pajit)  at  time  new]  G  t.  According  to  LPA, 

j^s[k,  ne»]);  further¬ 

more,  according  to  FG  it  must  be  true  that 

new'\  /,  \  _  new] 

j  5[/:  +  l,  neit)]v  +  new])  j  neit)]v  / 

<  FDf’ 

Hence,  if  router  s[k  —  1,  new]  processed  the  update  that 
node  s[k,new]  sent  at  time  new]^  then 


J  s[A:,  new]  ^  ' 
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D 


s[/:,  new] 
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However,  if  s[k  —  1,  new]  did  not  process  the  update  that 
node  s[^;,  new]  sent  at  time  new]^  then 


J  s[A;,  new]  V  J 


> 


new]/,  \ 

+  old]} 

new]  /,\ 

j  s[A  +  l,  nei(j]v  / 


because  router  s[k  +  1,  new]  must  be  a  feasible  succes¬ 
sor  for  router  s[k,new]  to  make  it  its  successor  at  time 
new]-  Therefore,  if  router  s[^;,  new]  is  already  pas¬ 
sive  when  it  changes  successor  at  time  new]^  then 

— 1,  new'\/,\  new'\ 

j  5 [A,  new]  V  /  ^  j  s[A  +  l,  neit)]V  /* 

Alternatively,  consider  the  case  in  which  router  s[^;,  new] 
is  active  from  time  tk  <  t  to  time  new]  when  it  be¬ 

comes  passive  again  to  join  Paj  (t).  In  this  case,  regardless 
of  the  value  of  router  s[k,  new]  must  have 

sent  a  query  to  its  neighbors  with  =  oo  at 

time  tk ,  and  all  of  those  neighbors  must  acknowledge  that 
value  of  ‘^^‘^\tk)  before  router  s[k,  new]  can  make 

any  changes  to  its  distance  at  time  new]- 

When  router  s[^;  —  1,  new]  makes  router  s[^;,  new]  its 
successor  when  it  joins  Pajit)  at  time  ts[k^  new]  ^  if  may 
or  may  not  have  processed  any  update  or  query  sent  by 
node  s[^;,  new]  at  time  nem]  ^  f  when  that  node 

joins  Paj  (t).  In  the  first  case, 

1,  new]/,\  _  new]/,  \ 

J  s[i,  new]  new]) 

_  nett)]/,  \ 
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new] 
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In  the  second  case,  =  Rd)^’  this 

is  impossible,  because  RDj^^’  ‘^'^‘^\tk)  =  oo  and  node  s[^;  — 
1,  new]  could  not  have  chosen  a  neighbor  reporting  an 
infinite  distance  as  its  successor. 

From  the  above  argument  it  follows  that,  if  a  router 
s[k,new]  is  passive  at  time  t,  then 

—  1  ,n  eiu]  pvs[/:,neit)] 

js[k,new]  ^  js[A  +  l,neitj]  v  ^ 

However,  because  all  the  routers  in  the  loop  Cj(t)  are  pas¬ 
sive  at  time  t,  traversing  path  Pai(t)  leads  to  the  erroneous 
conclusion  This  implies  that  a  loop  can¬ 

not  be  formed  when  Sj(G)  is  loop  free  before  time  t  and 
G  has  a  stable  topology.  On  the  other  hand,  the  handling 
of  queries  and  replies  in  LPA  is  not  modified  with  the  es¬ 
tablishment  or  failure  of  links,  and  G  is  loop-free  when  it 
is  first  stored  before  any  router  has  a  finite  distance  to  any 
other  node.  Therefore,  the  theorem  is  true.  □ 

5  Correctness  of  LPA 

To  prove  that  LPA  converges  to  correct  routing-table  val¬ 
ues  in  a  finite  time,  we  assume  that  there  is  a  finite  time 
after  which  no  more  link-cost  or  topology  changes  occur. 
Procedure  DT  makes  node  i  update  its  distance  table  in  a 
way  that  the  routing  information  assumed  from  all  neigh¬ 
bors  is  consistent,  as  discussed  in  section  3.2.  However, 
LPA  is  correct  even  if  such  consistency  of  neighbor  infor¬ 
mation  is  not  enforced,  and  is  not  assumed  in  the  following 
proof. 


Lemma  1  LPA  is  live. 

Proof:  Consider  the  case  in  which  the  network  has  a 
stable  topology.  When  a  router  is  in  the  active  state  and 
receives  a  query  from  a  neighbor,  the  router  replies  to  the 
query  with  an  infinite  distance.  The  router  updates  its 
distance  table  entries  when  either  an  update  or  a  reply 
message  is  received  in  active  state.  On  the  other  hand, 
when  a  router  in  passive  state  receives  a  query  from  its 
neighbor,  it  computes  the  feasible  distance  and  updates 
its  distance  and  routing  tables  accordingly.  If  the  router 
finds  a  feasible  successor,  it  replies  to  its  neighbor’s  query 
with  its  current  distance  to  the  destination.  If  the  router 
can  not  find  feasible  successor,  it  forwards  the  query  to 
the  rest  of  its  neighbors  and  sends  a  reply  with  an  infinite 
distance  to  the  neighbor  who  originated  the  query.  Accord¬ 
ingly,  in  a  stable  topology,  a  router  that  receives  a  query 
from  a  neighbor  for  any  destination  must  answer  with  a  re¬ 
ply  within  a  finite  time,  which  means  that  any  router  that 
sends  a  query  in  a  stable  topology  must  become  passive 
after  a  finite  time. 

Consider  now  the  case  in  which  the  network  topology 
changes.  When  a  link  fails  or  is  reestablished,  an  active 
router  that  detects  the  link  status  change  simply  assumes 
that  the  router  at  the  other  end  of  the  link  has  reported  an 
infinite  distance  and  has  replied  to  the  ongoing  query.  Be¬ 
cause  an  active  router  must  detect  the  failure  or  establish¬ 
ment  of  a  link  within  a  finite  time,  and  because  router  fail¬ 
ures  or  additions  are  treated  as  multiple  link  failures  or  ad¬ 
ditions,  it  follows  from  the  previous  case  that  no  router  can 
be  active  for  an  indefinite  period  of  time,  and  the  lemma 
is  true.  □ 

Lemma  2  TRT  correcily  enforces  Property  1. 

Proof:  TRT  correctly  enforces  Property  1  if  the  tag  value 
given  by  TRT  at  router  i  for  destination  j  equals  correct. 
This  is  true  only  when  the  neighbor  n  that  router  i  chooses 
as  successor  to  j  offers  the  smallest  distance  from  i  to  each 
node  in  its  reported  implied  path  from  n  to  j. 

First  note  that,  procedure  DT  is  executed  before  TRT 
and  ensures  that  router  i  sets  D*  j  =  oo  if  its  neighbor  b 
reports  a  path  to  b  that  includes  i.  Therefore,  TRT  deals 
with  simple  paths  only. 

According  to  procedure  TRT,  there  are  two  cases  in 
which  a  router  stops  tracing  the  routing  table:  (1)  the 
trace  reaches  node  i  itself  (i.e.,  =  i),  and  (2)  a  node 

on  the  path  to  j  is  found  with  tagl.  =  correct.  We  prove 
that  the  correct  path  information  is  reached  in  both  cases. 

Case  1:  Assume  that  TRT  is  executed  for  destination 
j  after  an  input  event.  The  tag  for  each  destination  af¬ 
fected  by  the  input  event  is  set  to  null  before  procedure 
TRT  is  executed.  Therefore,  if  TRT  is  executed  for  desti¬ 
nation  j  and  node  i  (the  source)  is  reached,  the  tag  of  each 
node  in  the  path  from  i  to  j  through  neighbor  n  must  be 
null.  Therefore,  the  distance  from  i  to  j  through  n  is  the 
shortest  path  among  all  neighbors,  because  node  i  chooses 
the  minimum  in  row  entry  among  its  neighbors  for  a  given 
destination  j,  and  the  lemma  is  true  for  this  case. 


Case  2'.  If  node  Xi  with  =  correct  is  reached,  then 

it  must  be  true  that  either  node  i  or  a  node  X2  with  tagl.^ 
=  correct  is  reached  from  Xi. 

If  node  i  is  reached  from  xi,  then  it  follows  from  Case 
1  that  neighbor  n  offers  the  smallest  distance  among  all 
of  f’s  neighbors  to  each  node  in  the  implied  subpath  from 
n  to  xi  reported  by  neighbor  n.  Furthermore,  because  xi 
is  reached  from  j,  node  n  must  also  offer  the  smallest  dis¬ 
tance  among  all  of  f’s  neighbors  to  each  node  in  the  implied 
subpath  from  Xi  to  j  reported  by  n.  Therefore,  it  follows 
from  Case  1  that  the  lemma  is  true.  Otherwise,  if  X2  is 
reached,  the  argument  used  when  i  is  reached  from  Xi  can 
be  applied  to  X2.  Because  router  i  always  sets  tagl  =  cor¬ 
rect  and  TRT  deals  with  simple  paths  only,  this  argument 
can  be  applied  recursively  only  for  a  maximum  oi  h  <  00 
times  until  i  is  reached,  where  h  is  the  number  of  hops  in 
the  implicit  path  from  n  to  j  reported  by  n  to  i.  Therefore, 
Case  2  must  reduce  to  Case  1  and  it  follows  that  the  lemma 
is  true.  □ 

Lemma  3  The  change  in  ike  cost  or  stains  of  a  link  is 
reflected  in  ike  distance  and  ike  routing  tables  of  a  router 
adjacent  to  ike  link  within  a  finite  time. 

Proof:  Regardless  of  the  state  in  which  router  i  is  for 
a  given  destination  j,  it  updates  its  link-cost  and  distance 
table  within  a  finite  time  after  it  is  notified  of  an  adjacent 
link  changing  its  cost,  failing,  or  starting  up.  On  the  other 
hand,  router  i  is  allowed  to  update  its  routing  table  for 
destination  j  only  when  it  is  in  passive  state  for  that  desti¬ 
nation.  However,  because  LPA  is  live  (Lemma  1),  if  router 
i  is  active  for  destination  j,  it  must  receive  all  the  replies 
to  its  query  regarding  j  within  a  finite  time,  i.e.,  when  it 
becomes  passive.  When  router  i  becomes  passive  for  des¬ 
tination  j,  it  executes  Procedure  TRT,  which  updates  the 
routing-table  entry  for  destination  j  using  the  most  recent 
information  in  router  f’s  distance  table.  This  implies  that 
any  change  in  a  link  is  reflected  in  the  distance  and  routing 
tables  of  a  neighbor  router  within  a  finite  time  T.  □ 

Given  Lemma  3  and  our  assumption  about  time  T^,  a 
finite  time  must  exist  when  all  routers  adjacent  to  the  links 
that  changed  cost  or  status  have  updated  their  link  cost 
and  status  information,  and  after  which  no  more  link-cost 
or  topology  changes  occur.  Let  T  denote  that  time,  where 
Tg  <  T  <  00. 

Theorem  2  After  a  finite  time  t  >  T,  ike  routing  tables 
of  all  routers  must  define  ike  final  shortest  path  to  each 
destination. 

Proof:  Let  T(H)  be  the  time  at  which  all  messages  sent 
by  routers  with  shortest  paths  having  H  —  1  hops  (H  > 
1)  to  a  given  destination  j  have  been  processed  by  their 
neighbors. 

Assume  that  destination  j  is  reachable  from  every  router. 

For  any  router  a  adjacent  to  j,  it  follows  from  Lemma  3 
that,  if  router  a’s  shortest  path  to  j  is  the  link  (a,  j),  then 
router  a  must  update  £)“  =  daj  by  time  T  =  T(0)  and  the 
theorem  is  true  for  H  =  0. 

Because  LPA  is  loop  free  at  every  instant  (Theorem  1), 
the  number  of  hops  in  any  shortest  path  (as  implied  by 


the  successor  graph)  is  finite.  Accordingly,  the  proof  can 
proceed  by  induction  on  H . 

Assume  that  the  theorem  is  true  for  some  H  >  0.  Ac¬ 
cording  to  this  inductive  assumption,  by  time  T{H),  router 
i  must  have  a  correct  routing-table  entry  for  every  desti¬ 
nation  for  which  it  has  a  shortest  path  of  H  hops  or  less. 
Property  1  must  be  satisfied  for  all  such  destinations  and 
LPA  enforces  it  correctly  (Lemma  2).  On  the  other  hand, 
from  the  definition  of  T(H  +  1),  it  follows  that  any  update 
messages  sent  by  routers  with  shortest  paths  of  H  hops 
or  less  to  j  or  any  other  destination  have  been  processed 
by  their  neighbors  by  time  T(H  +  1).  Therefore,  if  router 
f’s  shortest  path  to  destination  j  has  H  +  1  hops.  Prop¬ 
erty  1  must  be  satisfied  at  router  i  for  that  destination  by 
time  T(H  +  1),  because  all  possible  predecessors  for  desti¬ 
nation  j  must  satisfy  Property  1  at  router  i  and  that  router 
must  have  the  correct  information  for  link  (i,Sj)  at  time 
T(0)  <  T(R  +  1)  (Lemma  2).  It  follows  that  the  theorem 
is  true  for  the  case  of  a  connected  network. 

Consider  the  case  in  which  j  is  not  accessible  to  a  con¬ 
nected  component  C  of  the  network.  Assume  that  there  is 
a  router  i  ^  C  such  that  <  00  at  some  arbitrarily  long 
time.  If  that  is  the  case,  j  must  satisfy  Property  1  through 
at  least  one  of  router  f’s  neighbors  at  that  time;  the  same 
applies  to  such  a  neighbor,  and  to  all  the  routers  in  at  least 
one  path  from  i  to  j  defined  by  the  routing  tables  of  routers 
in  C.  This  is  not  possible,  because  C  is  finite  and  LPA  is 
always  free  of  loops  and  live,  which  implies  that,  after  a 
finite  time  tj  >T,  all  paths  to  j  defined  by  the  successor 
entries  in  the  routing  tables  of  routers  in  C  must  lead  to 
routers  that  have  set  their  distance  to  j  equal  to  00.  There¬ 
fore,  because  C  is  finite,  LPA  is  live,  and  messages  take  a 
finite  time  to  be  transmitted,  it  follows  that  destination  j 
will  fail  to  satisfy  Property  1  at  each  router  within  a  finite 
time  t  >  tf ,  and  routers  must  then  set  their  distances  to 
infinity,  and  the  theorem  is  true.  □ 

Theorem  3  A  finite  time  after  t,  no  new  update  messages 
are  being  transmitted  or  processed  by  routers  in  G,  and  all 
entries  in  distance  and  routing  tables  are  correct. 

Proof:  After  time  T,  the  only  way  in  which  a  router 
can  send  an  update  message  is  after  processing  an  update 
message  from  a  neighbor.  Accordingly,  the  proof  needs  to 
consider  three  cases,  namely:  router  i  receives  an  update, 
a  query,  or  a  reply  from  a  neighbor. 

Consider  an  arbitrary  router  i  G.  Because  LPA  is  live 
(Theorem  1)  and  router  i  obtains  its  shortest  distance  and 
corresponding  path  information  for  destination  j  in  a  finite 
time  after  T  (Theorem  2),  router  i  must  be  passive  within 
a  finite  time  >  T. 

If  router  i  receives  an  update  for  destination  j  from 
router  k  after  time  t,,  router  i  must  execute  Procedure 
Update.  If  router  i  has  no  path  to  destination  j,  must 
be  infinity  and  router  k  must  report  an  infinite  distance 
as  well,  because  router  i  achieves  its  final  shortest-path  at 
time  ti]  in  this  case,  router  i  simply  updates  its  distance 
table.  On  the  other  hand,  if  router  i  has  a  path  to  desti¬ 
nation  j,  then  Dj  <  00  and  router  i  must  find  that  FC  is 


satisfied  and  execute  Procedure  TRT.  Because  an  update 
entry  is  added  only  when  the  shortest  distance  or  prede¬ 
cessor  to  j  change,  router  i  can  send  no  update  or  query  of 
its  own. 

If  router  i  receives  a  query  from  a  neighbor  for  destina¬ 
tion  j  after  time  t,,  it  must  execute  Procedure  Query.  If 
router  i  has  no  physical  path  to  destination  j,  must  be 
infinity  and  router  k  must  report  an  infinite  distance  in  its 
query,  because  router  i  achieves  its  final  shortest-path  at 
time  ti]  in  this  case,  router  i  simply  updates  its  distance 
table  and  sends  a  reply  to  router  k  with  an  infinite  dis¬ 
tance.  On  the  other  hand,  if  router  i  has  a  physical  path 
to  destination  j,  it  must  determine  that  FC  is  satisfied 
when  it  processes  router  k’s  query.  Accordingly,  it  simply 
sends  a  reply  to  its  neighbor  with  its  current  distance  and 
predecessor  to  router  j.  Therefore,  router  i  cannot  send  an 
update  or  query  of  its  own  when  it  processes  a  query  from 
a  neighbor  after  time  tj. 

After  time  t,,  router  i  cannot  receive  a  reply  from  a 
neighbor,  unless  it  first  sends  a  query  after  time  ti,  which 
is  impossible  according  to  the  above  two  paragraphs. 

It  follows  from  the  above  that,  for  any  given  destina¬ 
tion,  no  router  in  G  can  generate  a  new  update  or  query 
after  it  reaches  its  final  shortest  path  and  predecessor  to 
that  destination.  Because  every  router  must  obtain  its  fi¬ 
nal  shortest  distance  and  predecessor  to  every  destination 
within  a  finite  time  (Theorem  2),  the  theorem  is  true.  □ 

6  Performance  of  LPA 

6.1  Complexity 

This  section  compares  LPA’s  worst-case  performance  with 
respect  to  the  performance  of  DBF,  DUAL,  and  ILS.  This 
comparison  is  made  in  terms  of  the  overhead  required  to 
obtain  correct  routing-table  entries  assuming  that  the  al¬ 
gorithm  behaves  synchronously,  so  that  every  router  in  the 
network  executes  a  step  of  the  algorithm  simultaneously 
at  fixed  points  in  time.  At  each  step,  the  router  receives 
and  processes  all  the  inputs  originated  during  the  preceding 
step  and  if  required,  sends  update  messages  to  the  neigh¬ 
boring  routers  at  the  same  step.  The  first  step  occurs  when 
at  least  one  router  detects  a  topological  change  and  issues 
update  messages  to  its  neighbors.  During  the  last  step, 
at  least  one  router  receives  and  processes  messages  from 
its  neighbors  and  after  which  the  router  stops  transmit¬ 
ting  any  update  messages  till  a  new  topological  change  has 
taken  place.  The  number  of  steps  taken  for  this  process  is 
called  the  time  complexity  (TC);  the  number  of  messages 
required  to  accomplish  this  is  called  the  communication 
complexity  (CC). 

DBF  has  a  worst-case  time  complexity  of  0(|iV|)  and 
worst-case  communication  complexity  of  0(|iV^|),  where 
|iV|  is  the  number  of  routers  in  the  network  G  [5].  ILS 
requires  that  each  change  in  the  cost  or  status  of  a  link  be 
communicated  to  all  the  routers  in  the  network;  accord¬ 
ingly,  it  has  TG  =  0(d)  (where  d  is  the  network  diameter), 
because  a  link-state  update  must  traverse  the  whole  net¬ 


work,  and  GG  =  0(E),  because  each  update  traverses  each 
link  at  most  once  in  ILS  but  each  link  has  two  states,  one 
in  each  direction  of  the  link.  On  the  other  hand,  DUAL 
has  TG  =  0(x)  and  GG  =  0(x),  where  x  is  the  number  of 
routers  affected  by  the  single  topology  change  [5]. 

In  [21],  it  is  shown  that  the  time  complexity  of  an  algo¬ 
rithm  like  LPA  is  0(x)  in  the  worst-case,  where  x  is  the 
number  of  routers  affected  in  the  change. 

6.2  Average  Performance 

We  compare  LPA’s  performance  by  simulation  with  the 
performance  of  ILS,  DUAL  and  a  path-finding  algorithm 
similar  to  LPA  that  we  simply  call  the  basic  path  finding 
algorithm  (BPFA)  [19].  The  key  differences  between  LPA 
and  BPFA  are  that  BPFA  has  no  interneighbor  coordina¬ 
tion  to  block  temporary  loops,  and  each  update  causes  a 
node  to  update  its  entire  routing  table,  just  like  in  other 
path-finding  algorithms  [3,  10]. 

A  set  of  counters  were  used  to  instrument  the  simula¬ 
tions.  These  counters  can  be  reset  at  various  points.  When 
the  event  queue  empties,  that  is,  when  the  algorithm  con¬ 
verges,  the  values  of  these  counters  are  printed.  During 
each  simulation  step,  a  router  processes  input  events  re¬ 
ceived  during  the  previous  step  one  at  a  time,  and  generates 
messages  as  needed  for  each  input  event  it  processes.  To 
obtain  the  average  figures,  the  simulation  makes  each  link 
(router)  in  the  network  fail,  and  counts  the  steps  and  mes¬ 
sages  needed  for  each  algorithm  to  recover.  It  then  makes 
the  same  link  (router)  recover  and  repeat  the  process.  The 
average  is  then  taken  over  all  link  (router)  failures  and  re¬ 
coveries.  The  routing  algorithm  was  allowed  to  converge 
after  each  such  change.  The  average  is  taken  over  all  fail¬ 
ures  and  recoveries.  In  all  cases,  routers  were  assumed  to 
perform  computations  in  zero  time  and  links  were  assumed 
to  provide  one  time  unit  of  delay.  For  the  failure  and  recov¬ 
ery  runs,  the  costs  were  set  to  unity.  Both  the  mean  and 
the  standard  deviation  were  computed  for  each  counter; 
the  four  counters  used  are 

•  Events:  The  total  number  of  updates  and  changes  in 
link  status  processed  by  routers. 

•  Packets:  The  total  number  of  packets  transmitted  over 
the  network.  Each  packet  may  contain  multiple  up¬ 
dates. 

•  Duration:  The  total  elapsed  time  it  takes  for  the  al¬ 
gorithm  to  converge. 

•  Operations:  The  total  number  of  operations  performed 
by  the  algorithm.  The  operation  count  is  incremented 
when  an  event  occurs. 

In  this  paper,  we  focus  on  simulation  results  for  the 
ARPANET  topology;  similar  simulation  results  for  other 
network  topologies  appear  elsewhere  [18]. 

The  simulation  results  for  a  single  resource  change  are 
shown  in  Table  1.  The  table  shows  the  average  number 
of  events  (updates  and  link-status  changes  processed  by 
routers),  the  average  number  of  update  messages,  the  aver¬ 
age  number  of  steps  and  the  average  number  of  operations 


required  by  all  the  routers  in  the  network  for  BPFA,  LPA, 
DUAL  and  ILS  to  converge  after  a  single  topology  change. 

BPFA  incurs  fewer  steps  in  the  average  than  the  rest  of 
the  algorithms  after  single  failures.  This  is  because  Pro¬ 
cedure  DT  of  LPA,  which  is  the  basis  of  BPFA’s  opera¬ 
tion,  prevents  the  formation  of  temporary  loops  without 
the  need  for  any  internodal  coordination.  However,  the 
results  obtained  for  LPA  after  router  or  link  failures  are 
very  encouraging.  Because  of  the  inter- neighbor  synchro¬ 
nization  scheme  used  in  LPA,  it  can  be  expected  that  at 
least  two  additional  steps  are  needed  for  convergence  after 
a  router  failure,  in  addition  to  the  steps  required  to  prop¬ 
agate  link-failure  updates  across  the  network.  This  is  be¬ 
cause  a  wave  of  queries  must  propagate  from  the  routers  de¬ 
tecting  the  failure  of  the  links  adjacent  to  the  failed  router, 
to  the  routers  that  are  the  farthest  from  the  sources  of 
updates. 

The  small  difference  between  the  number  of  steps  re¬ 
quired  in  LPA  and  BPFA  indicates  that  LPA’s  inter-neighbor 
coordination  mechanism  achieves  loop  freedom  at  every 
instant  with  little  overhead.  Another  important  point  of 
comparison  between  LPA  and  BPFA  is  the  number  of  oper¬ 
ations  they  require.  In  BPFA,  the  entire  shortest-path  tree 
defined  in  the  routing  table  has  to  be  traversed  every  time 
a  router  processes  an  input  event.  In  contrast,  in  LPA, 
Procedure  TRT  traverses  only  those  routing-table  entries 
affected  by  the  input  event.  The  results  clearly  show  that 
considerable  efficiency  is  gained  by  the  tagging  mechanism 
used  in  LPA. 

The  graphs  in  Figures  7  and  8  depict  the  number  of  mes¬ 
sages  exchanged  before  LPA,  DUAL  and  ILS  converge  for 
every  link  failing  and  recovering  in  the  ARPANET  topol¬ 
ogy  after  a  single  topology  change.  Similar  graphs  for  each 
node  failing  and  recovering  are  given  in  Figures  9  and  10, 
respectively.  All  topology  changes  were  performed  one  at 
a  time  and  the  algorithms  were  allowed  to  converge  after 
each  such  change  before  the  next  resource  change  occurs. 
The  ordinates  of  the  graphs  represent  the  identifiers  of  the 
links  and  the  nodes,  while  the  data  points  show  the  number 
of  messages  exchanged  after  each  resource  change  in  each 
of  these  figures. 

The  simulation  results  show  that  LPA  and  DUAL  have 
better  overall  average  performance  than  ILS  after  the  re¬ 
covery  of  a  single  router  or  link.  In  the  average,  LPA  re¬ 
quires  fewer  steps,  messages,  and  CPU  cycles  than  DUAL 
does  after  a  single  resource  failure  or  addition.  LPA  also 
requires  a  comparable  number  of  steps  and  update  mes¬ 
sages  than  ILS  does  after  a  single  resource  failure,  but  re¬ 
quires  orders  of  magnitude  fewer  operations.  Furthermore, 
the  number  of  entries  per  update  message  in  LPA  is  very 
small. 

In  the  case  of  ARPANET,  up  to  eight  steps  are  needed 
to  reach  the  farthest  router,  and  two  more  steps  are  needed 
to  handle  the  last  query  and  reply  after  that.  The  simula¬ 
tion  results  show  that  approximately  nine  steps  are  needed 
in  the  average  case  for  LPA’s  convergence  after  a  router 
failure,  compared  to  ILS’s  eight  or  nine  steps. 

In  summary,  the  above  results  indicate  that  LPA  consti¬ 


tutes  a  more  scalable  solution  for  routing  in  large  internets 
than  ILS  and  DUAL.  Dynamics  of  LPA  is  discussed  in  [20]. 

6.3  Comparison  with  Prior  Path-Finding 
Algorithms 

LPA  is  the  first  path-finding  algorithm  that  provides  loop 
freedom  at  every  instant.  Reference  [3]  discusses  loop  free¬ 
dom;  however,  the  path  finding  algorithm  presented  in  that 
work  does  not  provide  loop-free  paths  at  every  instant.  The 
approach  proposed  in  [3]  relies  on  each  router  sending  a 
query  to  its  neighbors  with  the  intended  new  routing-table 
entries,  and  waiting  for  the  neighbors’  replies  before  mak¬ 
ing  the  change.  Data  packets  are  held  at  a  router  waiting 
for  its  neighbors’  replies.  This  approach  incurs  substantial 
communication  overhead,  because  a  router  sends  queries 
every  time  it  tries  to  change  its  routing  table,  and  also 
incurs  unnecessary  queueing  delays  for  data  packets. 

Routing  algorithms  have  been  proposed  in  the  past  that 
provide  loop-free  paths  at  every  instant  by  blocking  po¬ 
tential  loops.  However,  in  these  algorithms  [7,  6],  a  router 
sends  path  information  to  its  neighbors  in  update  messages 
containing  explicit  labels  of  variable  size  that  can  contain 
the  complete  path  in  some  cases.  In  contrast,  LPA  uses 
fixed-size  entries  in  update  messages,  because  path  infor¬ 
mation  is  obtained  from  the  predecessor  entries. 

LPA  updates  routing  table  entries  using  Procedure  TRT, 
which  ensures  that  only  simple  paths  are  used.  This  mech¬ 
anism  is  similar  to  those  proposed  in  [3,  17];  however.  Pro¬ 
cedure  DT  in  LPA  makes  a  router  check  the  consistency  of 
predecessor  information  reported  by  all  its  neighbors  each 
time  an  input  event  is  processed.  In  contrast,  earlier  path 
finding  algorithms  [3,  17,  10]  check  the  consistency  of  the 
predecessor  information  only  for  the  neighbor  associated 
with  the  input  event. 

LPA  is  more  scalable  than  the  algorithms  in  [3,  10],  be¬ 
cause  LPA  updates  only  those  entries  of  the  distance  and 
routing  tables  that  are  affected  by  the  input  event,  rather 
than  the  entire  tables,  using  tags  similar  to  those  used  in 
[17].  In  contrast,  the  algorithm  in  [10]  uses  a  breath-first 
search  on  the  entire  distance  table  each  time  a  router  pro¬ 
cesses  an  input  event;  the  algorithm  reported  in  [3]  makes 
sure  that  Property  1  is  satisfied  by  all  destinations  every 
time  an  input  event  is  processed,  much  like  BPEA  does. 

7  Conclusions 

We  have  presented  and  verified  the  first  routing  algorithm 
(LPA)  that  eliminates  the  formation  of  temporary  rout¬ 
ing  table  loops  without  internodal  synchronization  span¬ 
ning  multiple  hops  or  the  communication  of  complete  or 
variable-length  path  information.  LPA  is  based  on  the  no¬ 
tion  of  using  information  about  the  second  to  last  hop  (pre¬ 
decessor)  of  shortest  paths  to  ensure  termination,  and  an 
efficient  inter-neighbor  coordination  mechanism  to  elimi¬ 
nate  temporary  loops.  The  worst-case  complexity  of  LPA 
for  single  recovery  or  failure  is  0(x),  x  being  the  number 


of  routers  affected  by  this  recovery  or  failure.  The  perfor¬ 
mance  comparison  of  LPA  and  BPFA  confirms  that  LPA 
achieves  loop-freedom  with  very  limited  additional  over¬ 
head  compared  to  similar  path-finding  algorithms.  Our 
simulation  results  show  that  taking  the  average  number  of 
steps,  messages,  and  operations  into  account,  LPA  is  more 
efficient  than  DUAL  and  ILS.  LPA  works  correctly  when 
routing  information  is  aggregated  (e.g.,  masks  are  used  to 
reduce  routing-table  size)  [22]  and  paves  the  way  towards 
developing  an  efficient  routing  protocol  based  on  LPA  for 
very  large  internetworks  that  is  as  simple  as  RIPv2  [13] 
and  much  more  efficient  than  OSPF  [16]. 
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Procedure  Initl 

when  router  i  initializes  itself 

do  begin 

set  a  link-state  table  with 
costs  of  adjacent  links; 

N  ^  {i};  ^  {x  \  <  <x}-, 

for  each  (x  €  ^i) 

N  ^  N  U  x;  null; 

H —  null;  H —  null; 

-I —  oo;  F  ^ —  oo 

end 

iD*  0;  FD^  ^  0; 

for  each  (n  €  ^i)  do 

for  each  j  ^  M  call  Init2(n,  j); 
for  each  (n  €  ^i)  do 
add  (0,  i,  0,  i)  to  LIST^(n); 


call  Send 


Procedure  lnit2(x,  j) 
begin 


Procedure  Send 
begin 

for  each  (n  € 

if  (LIST^(7i)  is  not  empty) 
then  send  message  with 
LIST^  (n)  to  n 
empty  LIST^in) 

end 

end 


Procedure  R,eply(j,  fc) 
begin 


0; 

=  0,  Vn 


€  ^t) 


then  if  ((3x  €  \  D\ 

OP  (Dj  <  oo)) 
then  call  PU(j) 
else  call  AU(j,  fc) 


<  oo) 


Procedure  h4essage 
when  router  i  receives  a  message 
on  link  (* ,  fc) 
begin 

for  each  entry 

j  \  j  ,  j,  j 

such  that  j  ^  i 
do  begin 

if  (j  g  N) 

then  begin 

if  (RD^  =  oo) 

V  j  ) 

then  delete  entry 
else  begin 

AT  ^  AT  U  { j  }  ;  Fr>\  =  oo ; 

for  each  x  € 

call  lnit2(x,  j) 


fagj 


call  DT(j,  fc) 


d 


null;  call  DT(j,  fc) 


for  each  entry  (  u^  ,  j,  RD^  ,  rp^  )  left 
such  that  j  ^  i 

do  case  of  value  of  u* 

J 

0:  [Entry  is  an  update] 
call  Update(j,  fc) 

1:  [Entry  is  a  query] 
call  Query  (j  ,  fc) 

2:  [Entry  is  a  reply] 
call  R,eply(g,  fc) 

end 


(.  =  J) 

do  case  of  value  of  w  * 

J 

1:  add  (2,  j,  0,  null)  to  LIST^{k) 

end 

end 

call  Send 


Procedure  Update(j,  fc) 
begin 

it  =  O.Vx  €  N.) 

then  begin 

it  ((•■  =  *)  OP  (D'.^  +  <  Oj)) 

then  call  PU(g) 

end 

else  call  AU(j,  fc) 


Procedure  PU(j) 
begin 


DT^,^  ^  Min{D^.  +d,^ 
mm  V  jx  ^  IX 

FCSET  {n  I  n  €  ATj,  iD* 

D^.  <  FD^.}; 

jn  ^  J  ’ 

if  {FCSET  ^  0)  then  begin 
call  TRT(j, 


X  e 

+  dij^  =  , 


FE>^. 

^  J 

else  begin 

FD^.  =  c 


M\ 


n{E>^.,FE>^.} 


'*  =1,  Vx  €  AT,  ; 

jx  * 


iffiD*.  =  oo)  then  s*  h —  m 
J  ’  3 

V  X  €  do  begin 
if  (query  and  x  =  k) 

then  r *  h —  0  ; 
jk 

else  add  (1,  j,  oo ,  null) 
to  LIST^{x) 


Procedure  Query(j,  fc) 
begin 

if  (r*  =  OVx  €  A",) 

then  begin 

if  {E>j  =  oo  and 
then  add  (2,  j,  iD*,  p*) 
to  LIST^{k) 
else  begin 

call  PU  (j); 
add  (2  ,  J  ,  iI5*  ,  p*  ) 
to  LIST^(k);  ^ 

begin 

add  (2,  J,  oo,  null)  to  LIST^{k) 
call  AU  (j  ,  k) 


Figure  1:  LPA  Specification 


Procedure  TRT(j 
begin 

if  (iD* 


+  d*  .  = 


•  b  I  {b  €  A'’!  and  =  iDT, 


•  31 


if  {Pxns  ~  ~  correct 

while  (iD^  = 

Min{D'^^^  +  djj,  V  b  €  A'j  } 
and  <  oo)  and  (tag^  =  i 

if  (p^  j^g  =  i  or  tag^  =  correct) 
then  tagj  •< —  correct; 

else  tag  .  •< —  error; 

.  3 

il  (iagj  =  correct) 

then  begin 

if  (iD*  3i  DT^,^  or  p*  ai  p* 

V  j  ■--  mjn  yj  -f-  yj 

then  add  (0,  j,  p* 

to  LIST^{x)  '^x  e 
L>^.  H —  DT^,^  ;  p*.  H —  p*.  ;  s 

end 

else  begin 

if  (iD*  <  oo) 

3 

then  add  (0,  j,  oo ,  null) 
to  LISTj^{x)  Vx  €  A'l; 

iD*.  H —  oo ;  p*.  H —  null; 

.3  3 

s*  null; 


.11)) 


end 

Procedure  Link.Up 

when  link  (*,  fc)  comes  up  do 

begin 

djj^  H —  cost  of  new  link; 
il  (k  i  N)  then  begin 

N  -t —  AT  U  {fc};  '^^3^  ^ —  null; 

Df  H —  oo;i^iI5?  H —  oo; 

k  .  k 

p,  H —  null;  s:  •< —  null; 

k  k 

for  each  x  ^  M. 

do  call  lnit2(x,  k) 

end 

•.—  ATj  U  {fc}; 
for  each  j  ^  M  do 
call  Ini  t2  (k  ,  j); 

for  each  j  ^  M  —  k  \  L>j  <  oo  do 
add  (0,  j,  iD*,  p*)  to  LISTj^(k)-, 

call  Send 


Procedure  Li  n  k_lD  ow  n  ( t ,  k) 
when  link  (t,  k)  fails  do  begin 

for  each  J  €  AT  do  begin 
call  DT(j,  fc); 
if  (fc  =  s*.)  then  iag^ 


^3k  ^ 
delete 


jk 

null; 


AT, 


•  A", 


{k}-, 


Jk’ 

for  each  j  €  (A  —  *)  |  fc  =  s*. 

call  Update(j,  fc) 
call  Send 

Procedure  Link_Change  (i,  k,  d^^) 
when  changes  value  do  begin 

old  H —  ^ik>  ^ik  ■" —  now  link  cost; 
for  each  J  €  A  —  i  do  begin 
call  DT(j,  fc); 

it  (o'.  >  +<J.b  then  begin 

tagj  H —  null; 
call  Update(j,  fc) 
end 

else  begin 

if  (fc  =  s*)  call  Update(j,  k) 

call  Send 
Procedure  AU  (j  , 
if  (fc  =  s*.)  then 

^  ^ Jk  ^J  ^  ^Jk 

Procedure  DT(j,  fc) 

for  each  neighbor  b  do  begin 


k) 


do  begin 

while  (h  ^  t  or 
do  h  ^  yJri,; 
if  (h  =  k)  then 


Jh 

end 

if  {h  =  i)  then 


kb 


Figure  2:  LPA  Specification  (cont...) 


e(l,l) 


(d) 


Figure  5:  Example  of  LPA’s  Operation 


Table  1:  Simulation  Results  for  ARPANET 


Parameter 

sdev 

Link  Failure 

Event  Count 

962.1 

392.9 

587.3 

381.5 

720.9 

449.1 

160.0 

0.0 

Packet  Count 

96.5 

45.9 

126.1 

59.8 

266.8 

97.3 

158.0 

0.0 

Duration 

7.16 

1.75 

9.24 

3.39 

15.1 

3.45 

8.5 

0.74 

Operation  Count 

843.90 

594.5 

385.6 

190.8 

813.9 

449.1 

25600.2 

57.  121 

Link  Recovery 

Event  Count 

638.2 

370.3 

242.4 

112.8 

362.2 

147.6 

162.7 

15.4 

Packet  Count 

108.6 

48.9 

33.0 

25.5 

79.3 

21.3 

160.7 

15.4 

Duration 

6.89 

1.51 

5.96 

2.75 

7.3 

1.46 

7.84 

0.67 

Operation  Count 

1144.9 

620.1 

213.2 

56.4 

454.2 

147.6 

26900.8 

2477  .9 

Router  Failure 

Event  Count 

1350.8 

373.8 

646.5 

424.4 

1050.4 

300.8 

218.8 

67.1 

Packet  Count 

96.6 

75.9 

144.7 

55.3 

382.6 

81.2 

212.1 

65.1 

Duration 

5.4 

3.4 

9.12 

2.4 

17.8 

9.2 

8.6 

0.72 

Operation  Count 

1803.8 

407.4 

589.5 

271.3 

1320.8 

563.5 

33356.7 

10  766.2 

Router  Recovery 

Event  Count 

980.4 

699.7 

551.6 

296.4 

691.9 

235.5 

301.2 

45.3 

Packet  Count 

107.2 

80.1 

68.06 

42.03 

207.9 

46.7 

294.5 

42.9 

Duration 

5.27 

2.56 

7.78 

3.33 

8.5 

0.73 

9.6 

1.14 

Operation  Count 

3252.0 

1911.5 

542.0 

224.4 

957.6 

347.3 

50102.2 

79  30.4 

